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We study a simple example of a sequential game illustrating problems connected with 
making rational decisions that are universal for social sciences. The set of chooser's 
optimal decisions that manifest his preferences in case of a constant strategy of the 
adversary (the offering player), is investigated. It turns out that the order imposed by the 
player's rational preferences can be intransitive. The presented quantitative results imply 
a revision of the " common sense" opinions stating that preferences showing intransitivity 
are paradoxical and undesired. 
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1. Introduction 

The intransitivity can occur in games with three or more strategies if the strategies 
A, B, C are such that A prevails over B, B prevails over C, and C prevails over A 
{A > B > C > A). The most known example of intransitivity is the children game 
"Rock, Scissors, Paper" {R,S,P) where R > S > P > R. The other interesting 
example of intransitive order is the so-called Condorcet's paradox, known since 
XVIIIth century. Considerations regarding this paradox led Arrow in the XXth 
century to prove the theorem stating that there is no procedure of successful choice 
that would meet the democratic assumptions [1] . The importance of this result to 
mathematical political science is comparable to Godel's Incompleteness Theorem in 
logic [2]. 

It seems logical to choose an order, in a consistent way between things we like. But 
what we prefer often depends on how the choice is being offered [3,4]. This paradox 
was perceived by many researchers and analysts (for instance Stan Ulam described 
this in his book " Adventures of a Mathematician" , some problems with intransitive 
options can be found in [5,6]). On the other hand scientists have a penchant for 
classifications (rankings) on basis of linear orders and this (we think) follows from 
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such intransitive preferences there are so suspicious for many researchers. 

In the paper, we present quantitative analysis of a model, which can be illus- 
trated by the Pitts's experiments with cats, mentioned in the Steinhaus diary [7] 
(Pitts noticed that a cat facing choice between fish, meat and milk prefers fish to 
meat, meat to milk, and milk to fish!). This model finds its reflection in the prin- 
ciple of least action that controls our mental and physical processes, formulated by 
Ernest Mach [8] and referring to Ockham's razor principle. 

Pitts's cat, thanks to the above-mentioned food preferences, provided itself with a 
balanced diet. In our work, using elementary tools of linear algebra, we obtained 
the relationship between the optimal cat's strategy and frequencies of appearance 
of food pairs. Experiments with rats confirmed Pitts's observations. Therefore, 
it is interesting to investigate whether intransitivity of preferences will provide a 
balanced diet also in a wider sense in more or less abstract situations involving de- 
cisions. Maybe in the class of randomized behaviors we will find the more effective 
ways of nutrition? The following sections constitute an attempt at providing quan- 
titative answer to these questions. The analysis of an elementary class of models of 
making optimal decision presented below permits only determined behaviors, that 
is such for which the agent must make the choice. 

Through this analysis we wish to contribute to dissemination of theoretical quan- 
titative studies of nondeterministic algorithms of behaviors which arc essential for 
economics and sociology - this type of analysis is not in common use. The geometri- 
cal interpretation presented in this article can turn out very helpful in understanding 
of various stochastic models in use. 

2. Nondeterministic cat 

Let us assume that a cat is offered three types of food (no. 1, no. 2 and no. 3), 
every time in pairs of two types, whereas the food portions are equally attractive 
regarding the calories, and each one has some unique components that are necessary 
for the cat's good health. The cat knows (it is accustomed to) the frequency of 
occurrence of every pair of food and his strategy depends on only this frequency. 
Let us also assume that the cat cannot consume both offered types of food at the 
same moment, and that it will never refrain from making the choice. The eight (2^) 
possible deterministic choice functions fk- 

/fe: {(1,0), (2,0), (2,1)} ^{0,1, 2}, fc = 0, . . . , 7 (1) 

are defined in Table 1. The functions /2 and determine intransitive orders. The 



Table 1. The table defining all possible choice functions /j,. 
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parameters pfe, = 0, . . . , 7 give the frequencies of appearance of the choice function 
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in the nondeterministic algorithm (strategy) of the cat {J2k=oP'' = 1) Pfc > for 
fc = 0,...,7). 

We will show the relationship between the frequency of occurrence of individual 
type of food in cat's diet and the frequencies of occurrence of food pairs. 
Let us denote the frequency of occurrence of the pair (fc,j) as (j„, . where m is the 
number of food that does not occur in the pair (fc,j) (X]^_q 9m = !)• This deno- 
tation causes no uncertainty because there are only three types of food. When the 
choice methods fk are selected nondcterministically, with the respective intensities 
Pk, the frequency Um, m = 0, 1, 2, of occurrence of individual food in cat's diet are 
according to Table 1. given as follows: 

• food no. 0: uq = {po + Pi + P2 + P3)q2 + (Po +P1+P4+ Ps)?!, 

• food no. 1: uji = (j)4 + p^ + pe + pr)q2 + {pa + P2 + P4 + P&)qn, 

• food no. 2: UJ2 = {p2 +P3+P6 + P7)qi + {pi + Ps + P5 +P7)qQ- 

Three equalities above can be explained with the help of the conditional probability 
concept. Let us denote -B3_(j+fc) = {(j, fc)}, P(Bj) = qj and Cj = {j} for j,k = 
0, 1, 2, j ^ k. The number P{Ck\Bj) indicates the probability of choosing the food 
of number k, when the offered food pair does not contain the food of number j. 
Since the events of choosing different pairs of food are disjoint and comprise all 
the space of elementary events. Hence, for each food chosen, we have the following 
relation: 

2 

u^k = P{Ck) - J2 P(Ck\Bj)P{B,), fc = 0, 1, 2. (2) 

By inspection of the table of the functions fk, k = 0, . . . ,7, we easily get the following 
relations: 

P{Co\B2) 
P{Co\Bi) 
P{Ci\Bo) 
P{Ci\B2) 
P(C2|Bi) 
P{C2\Ba) 

and P(Co|So) = P(Ci|Si) = P{C2\B2) = 0. 

Frequency of the least preferred food, that is the function min(a;o, wi, ^2), deter- 
mines the degree of the diet completeness. Since ujq+oji+uj2 = 1, the most valuable 



fk{B2) = 0) = Po + Pi + P2 + P3 , 
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k=0 
7 



P(]J fk (Bo) = l)=po+P2+P4+P6: 
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P{Y[fk{B2) = 1) =P4+P5+P6+P7, 
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1) = Pi + P3 + P5 + P7 ■ 
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(3) 
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way of choosing the food by the cat occurs for such probabihties po, . . . ,P7, that 
the function niin(a;o, ^^i, ^^2) has the maximal value, that is for 

Uo = UJi = UJ2 ^ l- (4) 

Any vector p — (po, . . . ,py) (or six conditional probabilities {P{Ci\Bo), P{C2\Bo), 
PiCo\Bi),P{C2\Bi),P{Ca\B2),P{Ci\B2))), which for a fixed triple (90,91,92) fulfills 
the system of equations Q will be called an cat's optimal strategy. 
Let us study this strategy in more details and subject it to geometrical analysis. 
For given go, 9i, 92 all optimal strategies are calculated. The system of equations 
(@J) has the following matrix form: 

PiCo\B2) P(Co|Si) 

PiC,\B2) P(Ci|So) I I 91 I = ^ I 1 I , (5) 



P(C2|Si) PiC2\Bo 




and its solution: 



defines a mapping of the three-dimensional cube [0, 1]'' in the space of parame- 
ters {P{Co\B2), P{Co\Bi), P{Ci\Bo)) into a triangle in the space of parameters 
(90,91,92), where d is the determinant of the matrix of parameters P{Cj\Bi). The 
barycentric coordinates [9] of a point of this triangle are interpreted as the prob- 
abilities qo, qi and 52- These numbers represent the heights a, b and c or the 
areas Pqab, Pqbc and Pqac of three smaller triangles determined by the point Q 
(cf. Fig.^l, or the lengths of the segments formed by the edges of the triangle by 
cutting them with the straight lines passing through the point Q and the opposite 
vertex of the triangle. Hence e.g. ^ — f — p^^^ = j^^' ^^'^''^ symbol \RB\ 
represents length of the segment. 

The next picture (Fig. [SJ presents the image of the three-dimensional cube in this 
simplex. It determines the area of frequency qm of appearance of individual choice 
alternatives between two types of food in the simplex, for which the optimal strat- 
egy exists. In order to present the range of the nonlinear representation of our 
interest, the authors illustrated it with the values of this representation for 10,000 
randomly selected points with respect to constant probability distribution on the 
cube. Justification of such equipartition of probability may be found in Laplace's 
principle of insufficient reason [10] . In our randomized model the a priori probability 
of the fact that the sum of probabilities P{Cj\Bk) is smaller than a given number 
a e [0, 1] equals a. The absence of optimal solutions outside the hexagon forming 
the shaded part of the picture (Fig. 2) is obvious, since the bright (non-dotted) part 
of the picture represents the areas, for which go > ^ (or gi > i, or (72 > 5), and the 
total frequency of appearance of pairs (0, 1) or (0, 2) must be at least i in order to 
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A R B 

Fig 1. The barycentric coordinates. 




Fig 2. Image of the three-dimensional cube on simplex. 



assure the completeness of the diet with respect of the ingredient (but this cannot 

happen because when go > f 7 then (71 + 92 = 1 — 9o < I)- 

The system of equations (jSJ can be transformed into the following form: 

92 -qi \ / P{Co\B2) \ / 1-91 \ 
-<Z2 qo W P(C2|i?l) ^ 1-92 , (7) 

qi -go / V ^(^il^o) / \^-qo J 

which allows to write out the inverse transformation to the mapping defined by 
equations ©• By introducing the parameter A we may write them as follows: 

PiCo\B,) = A , p(c,|SO = ^^i±^ , p^c,\Bo) = A±l^ . (8) 
6q2 6qi 6qo 

A whole segment on the unit cube corresponds to one point of the simplex, param- 
eterized by A. The range of this representation should be limited to the unit cube, 
which gives the following conditions for the above subsequent equations: 



A e [0,3^2], Ae[l-3gi,l], A e [3<72 - l,2-3gi]. 



(9) 
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The permitted values of the parameter A form the common part of these segments, 
hence it is nonempty for: 

max(0, 1 — 3(7i, 3q2 — 1) < min(2 — 3gi, 3^2, !)■ (10) 

Therefore 

A e [max(0, 1 - 3gi,3(72 - l),min(2 - iqi,2,q2, 1)]. (11) 

It may be now noticed that for any triple of probabilities belonging to the hexagon, 
there exists an optimal solution within a set of parameters {{P{C[)\B2), P(Co|i?i), 
P(Ci \Bq))). If we assume the equal measure for each set of frequencies of occurrence 
of food pairs as the triangle point, then we may state that we deal with optimal 
strategies in | of all the cases (it is the ratio of area of regular hexagon inscribed 
into a equilateral triangle). The inverse image of the area of frequencies [q^, 91, 92) 
of food pairs that enable realization of the optimal strategies, which is situated on 
the cube of all possible strategies, is presented by four consecutive plots in Fig. El 
We present there the same configuration observed from different points of view. The 
segments on the figures correspond to single points of the frequency triangle of the 
individual food pairs. The greatest concentration of the segments is observed in two 
areas of the cube that correspond to intransitive strategies^. The bright area in the 
center of the cube, which may be seen in the last picture, belongs to the effective 
strategies - effective in the subset of frequencies of a small measure (90,91792) of 
the food pairs appearance. Among them, the totally incidental behavior is located, 
which gives consideration in equal amounts to all the mechanisms of deterministic 
choice Pj ~ Pk = \ ■ 



3. Example of an optimal strategy 

The formulas ^ that map the triangle into a cube can be used to find an optimal 
strategy in cases, when the probabilities (90,91,92) of appearance of individual 
pairs of the products are known. Let us assume that go = 5 , 9i = ■! a-nd q2 ~ \ ■ 
Then, according to the formulas (jSJl, we have P(Ci\Bo) = | + ^'(Co|^2) = 
2A, P{C2\Bi) = A, where Ae [0, i]. Selecting A = i we have: P(Co|B2) = \, 
P{C2\Bi) = J , P{Ci\Bo) = ^ ■ We may now show the solution of equations lO, 
e.g.: Po = P5 = P7 — J and pj = for others parameters. We will obtain the 
following frequencies of occurrence of individual foods in the diet: 

1 1 1 

^0 = [Pa + Pbjqi + Po92 = 4 + Y2 ^ 3 ' 

wi = PoQa + {P5 + ^7)92 = \ + J2^\' ^■^^^ 

1 1 1 
^2 = (P5 + P7)qa + P79i = 4 + 12 " 3 ■ 

The above calculations of the frequency ujj confirm optimality of the indcterministic 
algorithm determined in this example. 



-'See section 4. 
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Fig 3. The inverse image of area of frequencies (50,91,92) that enable realization of the optimal 
strategy, see Appendix A. 



4. Intransitive nondeterministic decisions 

In the case of random selections we may talk about order relation food no. < 
food no. 1, when from the offered pair (0, 1) we are willing to choose the food no. 1 
more often than the food no. {P{Co\B2) < P{Ci\B2)). Therefore we have two 
intransitive orders: 

• P{Co\B2) < i, P(C2|Bi) < i, P(Ci|So) < i . 

• P{Co\B2) > i, P{C2\Bi) > i, P(Ci|So) > i . 

It is interesting to see in which part of the simplex of parameters (goi 91, 92) we may 
take optimal intransitive strategies. They form the six-armed star composed of 
two triangles, each of them corresponding to one of two possible intransitive orders 
(Fig. 0J . They dominate in the central part of triangle, near point 90 = 91 = 92 = ^ ■ 
They form darkened part of area inside the star. Optimal transitive strategies cover 
the same area of the simplex as all optimal strategies, however they occur less of- 
ten in the center of the simplex. We illustrated this situation in the next picture 
(Fig.EJ. In areas of high concentration of optimal transitive strategies, one of three 
frequencies go, 9i, 92 looses its significance - two from three pairs of the food occur 
with considerable predominance. We have enough information to be able to com- 
pare the applicability range of different types of optimal strategies. Let us assume 
the same measure of the possibility of occurrence of determined proportion of all 
three food pairs. This assumption means that the probability of appearance of the 
situation determined by a point in the triangle-domain of parameters (90,91,92) 
does not depend on those parameters. Two thirds of strategies are optimal. There 
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Fig 4. Optimal intransitive strategies. 




Fig 5. Optimal transitive strategies. 

are 33%^ of circumstances, which allow for the use of the optimal strategies that 
belong to the specified intransitive order. There are 44% (|) of situations of any 
order that favor optimal strategies, what follows from the fact that they are mea- 
sured by the surface of regular star, and its area is equal to double area of the 
triangle corresponding to one intransitive order reduced by the area of the hexagon 
inscribed into the star. So we have: 5 + § ~ f = |- Appearance of the number | 
in the calculation can be easily explained by the observation that the area of the 
regular six-armed star is two times bigger than the area of the hexagon inscribed 
into it. This number (22%) is the measure of the events that favor both types of 
intransitive strategies. 

It is worth to stress that in the situation that favors optimal strategies we can 
always find the strategy that determines the transitive order (see Fig.|2}. However, 
we should remember that this feature concerns only the simple model of the cat's 
behavior, and does not have to be true in the cases of more complicated reaction 
mechanisms. 



^They are measured by the area of equilateral triangle inscribed into a regular hexagon. 
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5. Conclusions 



In this article, we used a stochastic variant of the principle of least action. Perhaps 
dissemination of usage of this principle will lead to formulation of many interesting 
conclusions and observations. 

We presented a method, which allows successful analysis of intransitive orders that 
still are surprisingly suspicious for many researchers. More profound analysis of 
this phenomenon can have importance everywhere where the problem of choice be- 
havior is studied. For instance in economics (description of the customer preference 
toward products- marketing strategy) or in political science where the problem of 
voting exists. Analysis of intransitive orders is a serious challenge to those who seek 
description of our reasoning process. 

The quantitative observations from the previous section show that intransitivity, 
as the way of making the decision, can provide the diet completeness for the cat 
from our example. Moreover, the intransitive optimal strategies constitute the 
major part of all optimal strategies. Therefore, it would be wrong to prematurely 
acknowledge the preferences showing the intransitivity as undesired. Perhaps there 
are situations, when only the intransitive orders allow obtaining the optimal effects. 
The most intriguing problem that remains open, is to answer the question whether 
there exists a useful model of optimal behaviors, which gives the intransitive orders, 
and for which it would be impossible to specify the transitive optimal strategy of 
identical action results. Showing the impossibility of building such constructions 
would cause marginalization of the practical meaning of intransitive orders. On the 
other hand, indication of this type of models would force us to accept the intransitive 
ordering. 
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The following mini- program written in the language Mathematica 5. generate four 
plots in Fig. 13 
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In[l]:= c = N\ 



4 



gencorrect := Module[{a = c {Ra.ndom,[], B.andom.[]}} ,While[a[[2]] > |, 
a = c{Random[],RandomW}]; a]; 

setpoint := Module[{ql, a,x,y,v = l,w = 1}, While[ | u + | w > 1, 
a = gencorrect; ql = a[[2]]; x = a[[l]] — |; 
y = a[[2]] -l;v = Abs[x]; w = Abs[y]]; 
{ql,N[^x-^y+^]}]; 

setsegment := Module[{a, ql = l,q2= 1, 11 = 1,12 = 0}, 

While[ll >l2,a = setpoint; ql = a[[l]]; q2 = a[[2]]; 

11 = Max[0,l-3ql,3q2-l]; 

12 = Min[2 - 3 ql,3 q2,l]]; 

( ( 11 l-ll l-3g2+a 1 r 12 1-12 l-'Aq2-rl2 i -| i. 
tl3g2' 3gl ' 3(l-gl-g2) J ' 1-3 92' 3 gl ' 3(l-gl-g2) J J J ' 

fig[x- , y_ , zJ\ := Show[Graphics3D[{GrayLevel[.0], Thickness[.002], 

Table[Line[setsegment], {2000}]}], 
ViewPoint {x, y, z}, Axes True, 
AxesLabel ^ {"P(Co | S2)","P(C2 | Si)","P(Ci | Sq)"}, 
Ticks ^{{0,1}, {0,1}, {0,1}}, 
BoxStyle Dashing[{.02, .02}], 
AxesStyle Thickness[.005] ]; 

fig[-6, .7, .3] 
fig[.6, -3, .3] 
f2g[1.3,3A,2] 
/«5[3,-2,3] 
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